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Abstract Randomly-connected networks of integrate-and- 
fire (IF) neurons are known to display asynchronous ir- 
regular (AI) activity states, which resemble the discharge 
activity recorded in the cerebral cortex of awake animals. 
However, it is not clear whether such activity states are 
specific to simple IF models, or if they also exist in net- 
works where neurons are endowed with complex intrinsic 
properties similar to electrophysiological measurements. 
Here, we investigate the occurrence of AI states in net- 
works of nonlinear IF neurons, such as the adaptive expo- 
nential IF (Brette-Gerstner-Izhikevich) model. This model 
can display intrinsic properties such as low-threshold spike 
(LTS), regular spiking (RS) or fast-spiking (FS). We suc- 
cessively investigate the oscillatory and AI dynamics of 
thalamic, cortical and thalamocortical networks using such 
models. AI states can be found in each case, sometimes 
with surprisingly small network size of the order of a few 
tens of neurons. We show that the presence of LTS neurons 
in cortex or in thalamus, explains the robust emergence of 
AI states for relatively small network sizes. Finally, we 
investigate the role of spike-frequency adaptation (SFA). 
In cortical networks with strong SFA in RS cells, the AI 
state is transient, but when SFA is reduced, AI states can 
be self-sustained for long times. In thalamocortical net- 
works, AI states are found when the cortex is itself in an 
AI state, but with strong SFA, the thalamocortical network 
displays Up and Down state transitions, similar to intra- 
cellular recordings during slow-wave sleep or anesthesia. 
Self-sustained Up and Down states could also be gener- 
ated by two-layer cortical networks with LTS cells. These 
models suggest that intrinsic properties such as adaptation 
and low-threshold bursting activity are crucial for the gen- 
esis and control of AI states in thalamocortical networks. 
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1 Introduction 



In awake animals, the activity of single cortical neurons 
consist of seemingly noisy activity, with very irregular dis- 
charges at frequencies of 1-20 Hz and considerable fluctu- 
ations at the level of the membrane potential (V,„) (Mat- 
sumara et al., 1988; Steriade et al., 2001; Destexhe et al., 
2003; Lee et al., 2006). Model networks of leaky integrate- 
and-fire (IF) neurons can display activity states similar to 
the irregular spike discharge seen in awake cortex. These 
so-called "asynchronous irregular" (AI) states contrast with 
the "synchronous regular" (SR) states, or with oscillatory 
states (Brunei, 2000). AI states have been observed more 
recently as a self-sustained activity in more realistic IF net- 
works with conductance-based synapses (Vogels and Ab- 
bott, 2005). Such AI states typically require large network 
sizes, of the order of a few thousand neurons, to display 
characteristics consistent with experimental data (El Bous- 
tani et al., 2007; Kumar et al., 2008). 

In reality, neurons do not behave as leaky IF models, but 
rather display complex intrinsic properties, such as adap- 
tation or bursting, and these intrinsic properties may be 
important for neuronal function (Llinas, 1988). However, 
it is not clear to what extent AI states also appear in net- 
works of more realistic neurons. Similarly, the genesis of 
AI states has never been investigated in the thalamocorti- 
cal system. Recent efforts have been devoted to model in- 
trinsic neuronal properties using variants of the IF model 
(Smith et al., 2000; Izhikevich, 2004; Brette and Gerstner, 
2005). In the present paper, we use such models to analyze 
the genesis of AI states in cortical, thalamic and thalamo- 
cortical networks of neurons expressing complex intrinsic 
properties. 



2 Methods 
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We successively describe the equations used for model- 
ing neurons and synapses, the connectivity of the different 
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network models, as well as the methods used to quantify 
network activity. 



(Connors and Gutnick, 1990). The latter will be used to 
model cortical inhibitory intemeurons in the present model. 



2.1 Single-cell models 



To capture the intrinsic properties of central neurons, such 
as the rebound bursting capabilities of thalamic cells and 
the spike-frequency adaptation in cortex, we considered 
the adaptive exponential IF (aelF) model. This model con- 
sists of the two-variable IF model proposed by Izhike- 
vich (2004), which was modified to include an exponential 
non-linearity around spike threshold, based on the expo- 
nential IF model of Fourcaud-Trocme et al. (2003). These 
two models were combined by Brette and Gerstner (2005), 
leading to the following set of equations: 



A B 

RS cell RS cell 

(b=0.04) I (b=0.005) 



"•dt ^ 
dw 

IF ^ 



-gL [V-El] + giA exp[(y-Vr)/4] - w/S 



(1) 



[a (V-El)-w\, 



where C,„ = 1 /iF/cm^ is the specific membrane capaci- 
tance, gi = 0.05 mS/cm^ is the resting (leak) conductance. 
El = -60 mV is the resting potential (which is also equal 
to the reset value after spike), A = 2.5 mV is the steepness 
of the exponential approach to threshold, VV = -50 mV is 
the spike threshold, and S — 20,000 /im^ is the membrane 
area. When V reaches threshold, a spike is emitted and 
V is instantaneously reset and clamped to the reset value 
during a refractory period of 2.5 ms. w is an adaptation 
variable, with time constant t„. — 600 ms, and the dynam- 
ics of adaptation is given by parameter a (in /iS). At each 
spike, w is incremented by a value b (in nA), which regu- 
lates the strength of adaptation, as analyzed in more detail 
in the next section. 



2.2 Single-cell intrinsic properties 



The Brette-Gerstner-Izhikevich model was reported to dis- 
play a wide range of intrinsic neuronal properties (Izhike- 
vich, 2004; Brette and Gerstner, 2005). We focus here only 
on a few cell types commonly encountered in the thalam- 
ocortical system. Cortical neurons were modeled as "reg- 
ular spiking" (RS) cells with spike-frequency adaptation 
(Connors and Gutnick, 1990), which corresponds to the 
parameters a — 0.001 /iS and b — 0.04 nA in the aelF 
model (Fig. [IK)- The strength of adaptation can be mod- 
ulated by varying the parameter b, with b = 0.005 nA for 
weakly adapting cells (Fig.[T}3). This parameter was esti- 
mated heuristically based on Hodgkin-Huxley type mod- 
els and RS cells found in different preparations (Pospischil 
et al., 2008). For b = 0, the model generated responses 
with a negligible level of adaptation (Fig. [l]l!), similar to 
the "fast-spiking" (FS) cells encountered in cortex, and 
which corresponds mostly to cortical inhibitory neurons 



FS cell 
(b=0) 



LTS cell 




RE cell 




Fig. 1 Classes of neurons with different intrinsic neuronal proper- 
ties as modeled by the adaptive exponential integrate-and-fire model. 
A. Regular-spiking (RS) neuron with strong adaptation. B. RS neu- 
ron with weak adaptation. C. Fast-spiking (FS) cell with negligible 
adaptation. D. Low-threshold spike (LTS) cell. E. Thalamocortical 
(TC) neuron. F. Thalamic reticular (RE) neuron. In all cases, the re- 
sponse to a depolarizing current pulse of 0.25 nA is shown on top. 
For D-F, the bottom curves show the response to a hyperpolarizing 
current pulse of -0.25 nA. The units of parameter b in A-C are nA. 



Increasing the parameter a leads to bursting activity (Izhike- 
vich, 2004). If we consider a moderate value of a = 0.02 /iS, 
the model neuron also displays spike-frequency adapta- 
tion, even with b = (Fig.[T|Z), top). However, this model 
also generates a rebound burst in response to hyperpolar- 
izing pulses, while the conventional spike threshold is un- 
changed (Fig.[lJZ), bottom). This behavior is similar to the 
cortical low-threshold spike (LTS) cells (de la Pena and 
Geijo-Barrientos, 1996). 

A further increase of parameter a leads to more robust 
bursting activity and weaker spike-frequency adaptation, 
producing patterns of responses with moderate adaptation 
and strong rebound bursts (Fig.[lf ). This behavior was ob- 
tained for a — 0.04 /iS and b = 0. With larger values, b = 
0.08 /iS and a - 0.03 nA, the model generated bursting 
activity in response to both depolarizing and hyperpolar- 
izing stimuli (Fig. [if'), similar to thalamic reticular (RE) 
neurons (Destexhe and Sejnowski, 2003). 

Similar intrinsic properties as well as other types of behav- 
ior could be generated by other combinations of parame- 
ters (see Izhikevich, 2004), but were not considered here. 
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2.3 Network models 

Network models were constructed based on this aelF model, 
according to the following equations: 

Cm^ = -gL iy.-Ei) + giA, exp[(V-Vr,-)/A) - w,/5 
at 

(2) 

,/ 

where V, is the membrane potential of neuron and all 
parameters are as in Eqs. [H but were indexed to allow 
variations according to cell type (see Results). The term 
Y^jSji (yi~Ej) accounts for synaptic interactions, where 
gji is the conductance of the synapse from neuron j to neu- 
ron i (and which can be zero), and Ej 'k the reversal poten- 
tial of the synapse {Ej = mV for excitatory synapses and 
-80 mV for inhibitory synapses). Synaptic conductance 
time courses were exponential; once the presynaptic cell 
fired, a fixed increment was assigned to the correspond- 
ing gji (ge and gi for excitatory and inhibitory synapses, 
respectively), after which gji decays exponentially with a 
fixed time constant (5 ms for excitation and 10 ms for in- 
hibition). Different synaptic strengths gg and gi were con- 
sidered depending on the network type (see Results). No 
synaptic delays were considered. 

Note that because only small networks are considered here 
(of the order of tens to a few thousand neurons), synaptic 
strengths need necessarily to be large compared to physio- 
logical values. Typical values are = 6 nS and gi = 67 nS 
(Vogels and Abbott, 2005), which correspond to postsy- 
naptic potential sizes of 1 1 mV and 8.5 mV, respectively, 
at -70 mV and at rest. The amplitude of postsynaptic po- 
tentials will be vastly different in an active network, with 
typical values around 0.5 mV, respectively (El Boustani 
et al., 2007). Such a large difference is of course a prop- 
erty only seen in conductance-based models. It was shown 
that large networks (10,000 to over 100,000 neurons), with 
large numbers of synapses per neuron (> 500), are nec- 
essary to achieve configurations with plausible synaptic 
conductance values (El Boustani et al, 2007; Kumar et al., 
2008). 

To initiate activity, a number of randomly-chosen neurons 
(from 2% to 10% of the network) were stimulated by ran- 
dom excitatory inputs during the first 50 ms of the sim- 
ulation. The mean frequency of this random activity was 
high enough (200-400 Hz) to evoke random firing in the 
recipient neurons. In cases where self-sustained activity 
appeared to be unstable, different parameters of this initial 
stimulation were tested. It is important to note that after 
this initial period of 50 ms, no input was given to the net- 
work and thus the activity states described here are self- 
sustained with no external input or added noise. The only 
source of noise was the random connectivity (also termed 
"quenched noise".) 



All equations were solved using the NEURON simulation 
environment (Hines and Camevale, 1997). 



2.4 Connectivity 

In all cases, the connectivity was random, but respected 
the anatomical and morphological constraints about the 
connection probability between the different cell types, as 
described below for thalamus, cortex and thalamocortical 
relations. 



2.4.1 Thalamus 



The structure of the thalamus was approximated by a two 
layer network of randomly connected cells, including one 
layer of thalamocortical (TC) relay cells and one layer of 
thalamic reticular (RE) cells. In a number of species such 
as rodents, some thalamic nuclei are devoid of interneu- 
rons (Jones, 1985). There is also evidence that thalamic 
interneurons do not play a major role in the genesis of in- 
ternal dynamics, for example in oscillations (Steriade et 
al., 1985; von Krosigk et al., 1993). Thus, thalamic in- 
terneurons were not incorporated for simplicity. The tha- 
lamic network had 10 times less neurons compared to the 
cortical network, which corresponds to morphological es- 
timates (Sherman and Guillery, 2001). Based on anatomi- 
cal data showing that axonal projections within the thala- 
mic circuitry are local but sparse (FitzGibbon et al., 1995; 
Jones, 1985; Minderhoud, 1971), the excitatory projection 
from TC to RE cells had a connection probability of 2%, 
as in cortex, while the RE to TC inhibitory projection was 
more dense (Kim et al., 1997), and was here of a proba- 
bility of about 8%. The same density was assumed from 
inhibitory connections between RE cells. 

This connectivity scheme corresponds to thalamic networks 
of size A'= 100. When comparing networks of different size, 
the connection probability was rescaled inversely to net- 
work size, such that the number of synapses received by 
the neurons was invariant to size. 



2.4.2 Cortex 



In area 5 of cat cerebral cortex, axon collaterals from pyra- 
midal cells are profuse and dense but remain localized 
within a few hundreds of microns (Avendano et al., 1988). 
The connection densities of cells in the cortical network 
were organized such that each pyramidal cell (PY) or in- 
terneuron (IN) projected to a small proportion of about 2% 
of the size of the network. The same connection probabil- 
ity was also assumed for inhibitory connections. This con- 
nectivity was the same as that assumed in a previous model 
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of cortical AI states (Vogels and Abbott, 2005). These con- 
nection probabilities correspond to a cortical network of 
A'^=2000 neurons. As for thalamic networks, when differ- 
ent cortical network size were compared, the connection 
probability was rescaled inversely to network size to pre- 
serve the number of connections per neuron. 



2.4.3 Thalamocortical relations 



The thalamocortical and corticothalamic connections were 
also random, and their densities were estimated from mor- 
phological studies as follows. Ascending thalamocortical 
fibers give most of their synaptic contacts in layers I, IV 
and VI of cerebral cortex (White, 1986). Given that layer 
VI pyramidal neurons constitute the major source of corti- 
cothalamic fibers, these cells therefore mediate a monosy- 
naptic excitatory feedback loop (thalamus-cortex-thalamus; 
White and Hersch, 1982), which was modeled here. This 
monosynaptic loop is also demonstrated by thalamically- 
evoked antidromic and monosynaptic responses in the same, 
deeply lying cortical cell (see Fig. 5 in Steriade et al., 
1993b). The model incorporated the fact that all thalamic- 
projecting layer VI pyramidal cells connect TC cells while 
leaving axon collaterals in the RE nucleus. However, lower 
layer V pyramids also project to thalamic nuclei, but they 
do not leave collaterals in the RE nucleus (Bourassa and 
Deschenes, 1995); the latter were not modeled. We did not 
include either the influence of some thalamic intralaminar 
nuclei that project diffusely to the cerebral cortex as well 
as receive projections from it (Jones, 1985). 

Projections between thalamus and cortex are also local 
and sparse (Avendano et al., 1985; Jones, 1985; Robert- 
son and Cunningham, 1981; Updyke, 1981) but have more 
divergence than intrathalamic or intracortical connections 
(Bourassa and Deschenes, 1995; Freund et al., 1989; Landry 
and Deschenes, 1981; Rausell and Jones, 1995). In the 
model, each PY cell had some probability of connecting 
to TC and RE cells, but due to the large number of cortical 
neurons, this corticothalamic connectivity was much more 
extended than local thalamic connectivity, so that cortical 
synapses were majoritary in thalamus (80% of synapses 
in TC cells were from cortex), as demonstrated experi- 
mentally (Sherman and Guillery, 2001). Similarly, each 
TC cell projected to PY and IN cells, using a connec- 
tion probability of 2%. In these conditions, cortical con- 
nectivity was still dominated by intracortical synapses, as 
only about 6% of excitatory synapses were from thalamus, 
which corresponds well to estimates from morphological 
estimates (Braitenberg and Shutz, 1998). 

Thus, similar to a previous model (Destexhe et al., 1998), 
this thalamocortical model can be thought of representing 
cerebral cortex Layer VI, connected reciprocally with its 
corresponding thalamic area. All axonal projections of a 
given type were identical in extent from cell to cell and 
all synaptic conductances were equal. The total synaptic 
conductance on each neuron was the same for cells of the 



same type, independently of the size of the network. The 
connection probabilities are summarized in Table 1 . 



Connection type 


Connection probability 


Nb. synapses / neuron 


PY ^PY 


2% 


32 


PY ^IN 


2% 


32 


IN ^PY 


2% 


8 


IN ^IN 


2% 


8 


PY ^TC 


2% 


32 


PY ^RE 


2% 


32 


TC ^RE 


2% 


2 


RE ^TC 


8% 


8 


RE ^RE 


8% 


8 



Table 1 Connection probabilities between the different cell types. 
The probability is calculated for outgoing synapses, for example for 
the TC RE connection, the number indicated is the probabil- 
ity that a given TC cell connects one RE cell. In the last column, 
an example of the average number of incoming synapses (afferent 
synapses per neuron) is indicated for each type of connection in a 
network with 1600 PY, 400 IN, 100 TC and 100 RE neurons (TC 
= thalamocortical neurons; RE = thalamic reticular neurons; PY = 
cortical excitatory neurons; IN = cortical inhibitory interneurons). 



2.4.4 Two-layer cortical model 

Interlayer connectivity in cerebral cortex involves both ex- 
citatory and inhibitory connections, but is predominantly 
excitatory, with a connection density specific to the lay- 
ers considered (Thomson and Bannister, 2003; Binzeg- 
ger et al., 2004). Interlayer (vertical) connectivity is also 
in general less dense than intra-layer (horizontal) connec- 
tions. Two layers of cortical networks were modeled as 
described above, with excitatory-only interlayer connec- 
tivity with a probability of 1%, which is twice less dense 
than intra-layer connectivity (2%; see Table 1). 



2.5 Quantification of network states 

Network states were quantified according to two aspects: 
regularity and synchrony. To quantify the degree of tem- 
poral regularity, we used the coefficient of variation (CV) 
of the interspike intervals (ISI), averaged over all cells the 
network: 

- w) • 

where the brackets () indicate an average over all neurons, 
while ISIi and aj^' are respectively the mean and standard 
deviation of the ISIs of neuron The CV/si is expected 
to take large values > 1 for temporally irregular systems 
(the CV is 1 for a Poisson process). In this paper, we con- 
sidered that a system is "irregular" if the CVisi exceeds a 
value of 1 . 
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The degree of synchrony was quantified using the aver- 
aged pairwise cross-correlation between neurons in the net- 
work: 



cc = 



Cov{Si,Sj) 
a{Si)a{Sj) 



(4) 



where the brackets () indicate an average over a large num- 
ber of disjoint pairs of neurons (in general 500 pairs were 
used), Cov{Si,Sj) is the covariance between two spike counts 
Si,Sj, and o{Sij) is the standard deviation of each spike 
count. Spike counts were computed by counting spikes in 
successive time bins of fixed duration (5 ms; all results 
were also checked using 2 ms). The CC is comprised be- 
tween - 1 and 1 , and takes high values only for synchronous 
states. A given network state can reasonably be considered 
as "asynchronous" if CC is low enough (typically < 0.1). 
These criteria and methods were similar to that used pre- 
viously to characterize different states in network models 
(Brunei, 2000; Kumar et al., 2008; El Boustani and Des- 
texhe, 2009). 





|40mV 



200 ms 



Fig. 2 Oscillatory behavior in simple circuits of thalamic neurons. 
Top scheme: minimal circuit for spindle oscillations, consisting of 
two TC and two RE cells interconnected with excitatory (AMPA) 
and inhibitory (GABAa) synapses as indicated. This circuit gener- 
ated oscillations at a frequency around 12 Hz, and in which RE cells 
fired at every cycle while TC cell fired sub-harmonically, once every 
two cycles. Synaptic conductance values: ge = 30 nS, g, = 30 nS 



3 Results 



We successively consider network models for thalamus, 
cortex and the thalamocortical system, and analyze their 
dynamics as a function of their size and intrinsic proper- 
ties. 



3.1 Networks of thalamic neurons 



Interconnected thalamic TC and RE cells can generate os- 
cillations in the spindle (7-14 Hz) frequency range (re- 
viewed in Destexhe and Sejnowski, 2003). We first veri- 
fied that the aelF models outlined above were capable of 
replicating this oscillatory behavior. A small circuit of in- 
terconnected TC and RE cells was built, where all cells 
were interconnected, except for TC cells which do not 
have interconnections (Fig.|2l scheme). As shown in Fig.|2l 
this circuit generated self-sustained oscillations at a fre- 
quency around 10 Hz, with RE cells firing in response 
to EPSPs from TC cells, and TC cells firing in rebound 
to IPSPs from RE cells; the TC cells also generated sub- 
harmonic firing. These features are typical of spindle os- 
cillations (Steriade, 2003). This behavior is only possible 
by taking into account the intrinsic properties of thala- 
mic cells, and in particular the rebound bursting properties 
of TC cells (Destexhe and Sejnowski, 2003). As in more 
complex models, the oscillation frequency was dependent 
on the decay kinetics of synaptic currents, and the oscil- 
lation was observed for a large range of synaptic weights 
provided they were strong enough (not shown). 



Small-size networks of TC and RE cells were considered 
by considering more diffuse and random connectivity be- 
tween the two TC and RE layers, and weaker synaptic 
weights (see scheme in Fig. [3]). In these conditions, a A^=20 
network (10 TC and 10 RE cells) generated oscillatory 
behavior, but in contrast to the small circuit considered 
above, these oscillations appeared to be aperiodic, as seen 
from both rasterplot and single cells in Fig. [3] A phase 
plot between two TC cells (Fig.[3j3, inset), as well as the 
high value of the coefficient of variation {CVisi = 1 .36 in 
this case), confirmed the aperiodic character of the oscil- 
lation. The raster plot also shows that there is little syn- 
chrony in the firing of TC or RE cells, unlike the circuit 
of Fig. |2l This was confirmed by the low value of the av- 
eraged cross-correlation (CC = 0.025). This state resem- 
bles the "asynchronous regular" states described earlier 
(Brunei, 2000). This behavior was robust to long integra- 
tion times (up to 100 sec were tested) without evidence for 
periodic behavior, suggesting that this type of dynamics is 
self-sustained and aperiodic. Note that there is a possibil- 
ity that these regimes are periodic, but with a very long 
period which grows exponentially with network size (Ces- 
sac, 2008; Cessac and Vieville, 2009; see also Crutchfield 
and Kaneko, 1988; Tel and Lai, 2008). 

Networks comprising more thalamic neurons were con- 
sidered based on a similar connectivity scheme and the 
same synaptic weights as for N—20. By increasing the size 
from N=AQ to A^=100 generated patterns of aperiodic os- 
cillatory activity (Fig. |4]l. With larger sizes, the activity 
became more and more similar to an "asynchronous irreg- 
ular" state. For example, for a A^=100 network (Fig. Hf), 
the irregularity was high {CV[S[ = 1 .47) and the synchrony 
was low (CC = 0.016). 
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Fig. 3 Irregular oscillatory activity states in networks of 20 
randomly-connected thalamic neurons. Top: scheme of connectivity 
between the two layers of TC and RE cells, which were randomly 
connected. A. Raster plot of the spiking activity of the 20 neurons. 
B. Vm activity of two cells of each type. Synaptic conductance val- 
ues: ge = 6 nS, gi = 67 nS. The connection probability was of 8 % 
(from RE to TC, and RE to RE) and 2% (from TC to RE), as in Ta- 
ble 1. The activity is shown after a transient time of 50 sec. Inset in 
B: phase plot of the V,„ activity of cell I against that of cell 2, show- 
ing the non-periodic character of this activity (the CV]si was of 1.36 
and the CC was of 0.025). 
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for inhibitory conductances). The firing rate tended to in- 
crease with the level of inhibition, which is presumably 
a consequence of the rebound properties of thalamic neu- 
rons. There were also small differences between N=20 and 
A^=100 networks: the mean firing rate tended to be larger 
for = 100, while the averaged pairwise correlation was 
lower (Fig.|5] bottom panels). 



N=20 

Mean firing rate (Hz) 



N=100 




ivlean correiation 



Fig. 5 Domain of conductance parameters for self-sustained irreg- 
ular states in thalamic networks. Top Panels: mean activity rate cal- 
culated over the entire network, shown as a function of the synaptic 
conductance values (gg for excitation and g, for inhibition) for N=20 
(left) and A'=100 (right). Middle panels: corresponding coefficients 
of variation CVjsi calculated over all cells. Bottom panels: corre- 
sponding mean pairwise correlation CC calculated over N /2 dis- 
joint cell pairs in each network. The irregular oscillations appeared 
within a domain limited approximately by > 4 nS and g,- > 40 nS. 
Transient oscillations that did not survive 10 sec simulation time are 
not indicated. 



3.2 Cortical networks 



Fig. 4 Irregular activity states in thalamic networks of various sizes. 
The same connectivity scheme was used as in Fig. [3] but with larger 
sizes as indicated. Same synaptic conductance values and connection 
probabilities as in Fig. [3] Left panels: activity after a transient time 
of 50 sec. The CVisi and CC were respectively of 1.45 and 0.027 for 
N=m, 1.35 and 0.02 for A?=60, and 1.47 and 0.016 for 100. Right 
panels: distribution of firing rates for the two cell types. 



This behavior was seen for a large domain of values for 
the synaptic conductances. This aspect, and more gener- 
ally the robustness of irregular oscillations to synaptic con- 
ductances, was quantified in more detail in Fig. |5] The 
domain of oscillatory behavior was relatively large, pro- 
vided both conductances were above some threshold value 
(about 4 nS for excitatory conductance inputs and 40 nS 



We next considered the activity of cortical networks com- 
posed of excitatory RS and inhibitory FS cells, randomly 
connected. Unlike thalamic networks, cortical circuits of 
this type do not generate self-sustained AI states unless 
large networks are considered (Vogels and Abbott, 2005; 
Kumar et al., 2008). Compared to previous studies using 
leaky IF models, the present model considers more com- 
plex IF models, in particular for RS cells which display 
prominent spike-frequency adaptation. The cortical net- 
work had 80% excitatory and 20% inhibitory cells, and 
was randomly connected (see scheme in Fig. |6]l. In these 
conditions, the genesis of self-sustained AI states was pos- 
sible, but was highly dependent on the level of adaptation, 
as illustrated in Fig. |6] For strong to moderate adaptation, 
the network generated AI states but they were transient 
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and did not survive more than a few seconds (Fig.|6K)- For 
weak adaptation, the AI states could be sustained (Fig.|6^). 



N=400 





A 



b = 005 nA 
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LUIULJIL 
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I 100 mV 

I 1 sec 



B 



N=500 



Fig. 6 Transient and self-sustained irregular states in randomly- 
connected networks of cortical neurons. Top: scheme of connectiv- 
ity. A. Transient AI state in a 7^=2000 network, when the RS neu- 
rons had a significant adaptation. B. Self-sustained AI state in the 
same network after diminishing the strength of adaptation (CVisi = 
2.47, CC = 0.005; Inset: distribution of firing rates). Synaptic con- 
ductances: ge = 6 nS, gi = 67 nS, and connection probability as in 
Table 1. Note that in this case, PY cells are all of RS type, while all 
IN cells are of FS type. 
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The situation was radically different in the presence of 
LTS cells. Networks of relatively small size, A'=400 (Fig. [7]^) 
or A'^=500 (Fig.|7^), could generate self-sustained AI states 
if a proportion of LTS cells was present (LTS cells were 
connected identically as for RS cells). For 7V=400, the sys- 
tem exhibited intermittent-like dynamics (Fig.|7]^), which 
was typical of the transition between self-sustained oscil- 
lations, and AI type behavior. In this intermittency, the net- 
work switches between SR and AI states, while for larger 
networks, the dynamics remain in the AI state without in- 
termittency (Fig.|7^). 

To further characterize the role of LTS cells, the cross- 
correlation between LTS cells and inhibitory FS cells was 
calculated and compared with the cross-correlation between 
RS and RS cells (Fig.[8]|. Because the firing FS cells leads 
only to inhibition of RS cells, the cross-correlation is neg- 
ative for positive values of the time lag (Fig. [H arrow in 
black curve). It is also negative for negative time lags, pre- 
sumably due to the inhibition between FS cells. However, 
when correlating LTS cells with FS cells, the pattern was 
different for positive time lags, and positive correlations 
appeared (Fig. [8] arrow in red curve). This indicates that 
FS cells tend to excite LTS cells after some delay of about 
70 ms, which seems to correspond to the post-inhibitory 
rebound because LTS and RS cells had the same connec- 
tivity. This positive value was also observed for other net- 
work configurations with LTS cells (not shown). 
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Fig. 7 Self-sustained irregular states in small cortical networks with 
LTS cells. The network was composed of 80% excitatory (PY) cells 
and 20% inhibitory (IN) cells. 95% of PY cells were RS type and 5% 
were of LTS type, while all IN cells were of FS type. A. A'=400 net- 
work displaying self-sustained irregular activity (CV/si = 2.84, CC = 
0.05). B. AI state in a N=500 network {CVjsi = 2.07, CC = 0.05). In 
each case, the raster is shown on the left, with a few example cells 
on the right, together with the firing rate distribution in insets. Same 
synaptic conductances and connection probabilities as in Fig.m LTS 
cells are indicated in red (*). 
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LTS-FS 




200 

Time lag (ms) 

Fig. 8 Sign of rebound activity in LTS cells from cross-correlations. 
Cross-correlations between RS and FS cells (black), as well as be- 
tween LTS and FS cells (red) were computed from a. N = 500 
network (same simulation as in Fig. |7}3, but with a total time of 
50 sec). The cross-correlations were calculated from instantaneous 
rates (spiking activity in successive 5 ms bins), and were averaged 
between 400 non-overlapping pairs of cells for each type. The arrow 
shows that around 70 ms, a positive peak appears for LTS-FS corre- 
lations, presumably due to the post-inhibitory rebound of LTS cells. 
As expected, all correlations peaked at negative delays, betraying the 
excitatory action of RS and LTS cells onto FS cells. 



These results suggest that, through their post-inhibitory re- 
bound property, the presence of LTS cells increases the ex- 
citability of the network, enabling the genesis of AI states 
with relatively small network sizes. Indeed, by simulat- 
ing different network size, with and without LTS cells, re- 



vealed that the minimal size needed to sustain AI states 
was highly reduced in the presence of LTS cells (Fig. |9ll. 
Moreover, the minimal size was inversely related to the 
proportion of LTS cells (from 0% to 20%; see Fig.©. 
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Fig. 9 Minimal size for sustaining irregular states in cortical net- 
works. Simulations similar to Fig. |7] were performed for different 
network sizes (from 80 to 2000 neurons), and for different propor- 
tions of LTS cells (from 020correlation coefficient (CC, right) are 
plotted as a function of network size and proportion of LTS cells. All 
self-sustained states had high CV and low CC, as indicated (CV/5/ = 
and CC = indicate states with no self-sustained activity. The mini- 
mal size for displaying AT states was much reduced if LTS cells were 
present. It was of 1800, 800, 300, 200 and 100 neurons, respectively 
for 0, 2.5, 5, 10 and 20% of LTS cells. 



3.3 Thalamocortical networks 



The behavior of a thalamocortical network connected as 
schematized in Fig. [TO] (top) also depends on the level 
of adaptation in cortical cells. With strong adaptation, the 
network displayed alternating dynamics of active and silent 
periods (Up/Down states; see Fig.llOR). Progressively di- 
minishing adaptation (Fig.llOB-C) led to dynamics where 
the silent periods (Down states) were diminished while the 
active (Up) states were longer. For weak adaptation, the 
network displayed self-sustained AI states with no silent 
period (continuous Up state; Fig. [TOD). This latter state 
qualifies as an AI state, with CVjsi = 2.45 and CC = 0.004. 
The corresponding cellular activities are shown in Fig. II II 
Note that the firing rate of the model (around 40 Hz on av- 
erage) is larger than experimental data, for both up states 
and AI states. This is due to the relatively small size of the 
network, as only networks of large size can self-sustain AI 
states at low rates (El Boustani and Destexhe, 2009). 

Because neuromodulatory substances, such as acetylcholine 
or noradrenaline, block the K+ conductances responsible 
for adaptation (McCormick, 1992), the transition from Up 
& Down states to self-sustained active states in Fig.llOlbv 
reducing spike-frequency adaptation reminds the brain ac- 
tivation process. Experimentally, a transition from Up/Down 
state dynamics to self-sustained activated states can be ob- 
tained by electrical stimulation of the brain stem, inducing 
a cascade of cholinergic actions in thalamus and cortex 
(Fig. [IlK; Steriade et al., 1993a; Rudolph et al., 2005). 
One of the most prominent of these actions is a reduction 
in spike-frequency adaptation (McCormick, 1992). A very 
similar transition can be obtained in the model when the 
adaptation is reduced (from b=0.02 nA in A to ^=0.005 nA; 
see Fig.[T2b'). 
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Fig. 10 Self-sustained irregular and Up/Down states in thalamocor- 
tical networks. Top: Scheme of connectivity of the thalamocortical 
network. The network had 4 layers of cortical pyramidal (PY), cor- 
tical interneurons (IN), thalamic reticular (RE) and thalamocortical 
(TC) relay cells. Each cell is represented by a filled circle (dark gray 
= excitatory cells; light gray = inhibitory cells), and synaptic con- 
nections are schematized by arrows. Bottom panels: From A to D, 
the same model was used (2200 cells total, 1600 PY, 400 IN, 100 TC 
and 100 RE cells), but with different strengths of adaptation (from 
&=0.04 nA in A to fo=0.005 nA in D). In all rasters, only 10% of cells 
are shown for each cell type, and the 4 layers of cells are indicated 
on the right. For the AI state in D, cortical neurons were character- 
ized by a mean firing rate of 44 Hz, a coefficient of variation of CVisi 
= 2.45 and a pairwise correlation of CC = 0.004. 



3.4 Two-layer cortical networks 



The above mechanism for Up/Down states relies on the 
fact that the thalamus displays self-sustained AI states. 
In the present section, we present a similar mechanism 
but internal to cortex, in better agreement with experi- 
ments which reported self-sustained Up/Down state dy- 
namics in cortical slices (Sanchez- Vives and McCormick, 
2000; Cossart et al., 2003). To this end, the results from 
preceding sections were combined into a "two layer" cor- 
tical network in which one layer consisted of RS and FS 
cells, as described above (Fig. [6K), while a second layer 
was a smaller network of RS and FS cells, with some 
proportion of LTS cells, as in Fig. [7^. These two net- 
works were referred as "Layer A" and "Layer B", respec- 
tively (see scheme in Fig. [T3]l. When reciprocally con- 
nected with excitatory synapses, this 2-layer system exhib- 
ited Up/Down state dynamics with a mechanism similar to 
that described in the preceding section for thalamocortical 
networks. In the present case, the Layer B network gener- 
ated self-sustained activity, which served to ignite activity 
in the Layer A (see raster in Fig. [13] bottom). Interestingly, 
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Fig. 11 Cellular and averaged activity during self-sustained states 
in thalamocortical networks. The top graphs indicate the instanta- 
neous mean spike rate of cortical cells (in successive 1 ms bins), 
while the bottom traces display the V,„ activity of two cells of each 
type as indicated. A. Up/Down state transitions (same simulation as 
in Fig. HOB). The largest Down states are indicated in gray. B. Sus- 
tained active state (same simulation as in Fig. HOD). The same cells 
are indicated for each simulation. The inset shows a rebound burst 
in a TC cell at 10 times higher temporal resolution. 



this simulation shows that a network displaying transient 
dynamics (Fig. |6]\) connected with a network displaying 
AI states (Fig.jT^) yields a system displaying a different 
type of activity. Up and Down states in this case. This dy- 
namics was entirely self-sustained and coexisted with a 
stable resting state (Fig. [13] arrow). All of these behaviors 
are indissociable from the particular intrinsic properties of 
the neurons present in the system. 



4 Discussion 



In this paper, we have shown that networks of neurons dis- 
playing complex intrinsic properties can display various 
type of AI states. The main finding were that (a) thalamic 
networks, where neurons are endowed with rebound burst- 
ing capabilities, can display AI states for remarkably small 
size (N'^lOO). (b) Cortical networks display AI states, as 
reported previously (Brunei 2000, Vogels and Abbott, 2005), 
but when adaptation is included in excitatory neurons, cor- 
tical networks generate AI states only for weak adaptation, 
(c) Including a small proportion of LTS cells in cortical 
networks greatly reduces the minimal size needed to gen- 
erate AI states, (d) thalamocortical networks can display 
AI states or Up/Down state dynamics, depending on the 
level of adaptation in cortical cells, (e) Two-layer cortical 



! potential 




Fig. 12 Experiments and model of the transition from Up/Down 
to activated states. A. Transition from Up/Down state dynamics to 
an activated state, evoked by stimulation of the pedonculo-pontine 
tegmentum (PPT) in an anesthetized cat. The two traces respectively 
show the EEG and intracellular activity recorded in parietal cor- 
tex. B. Similar transition obtained by changing the value of b from 
0.02 nA to 0.005 nA (gray line). All other parameters were identical 
to Fig.[T0] Panel A modified from Rudolph et al., 2005. 



networks can self-sustain Up/Down states solely from in- 
trinsic dynamics. 

These numerical observations suggest that spike-frequency 
adaptation acts against the genesis of AI states, and tends 
to silence the network (Fig.|6|. Adaptation diminishes ex- 
citability, and several neuromodulators increase cortical 
excitability by blocking the slow K+ conductances respon- 
sible for adaptation (McCormick, 1992). Neuromodula- 
tion has also strong effects on leak conductances, in par- 
ticular in the thalamus (McCormick, 1992). We did not 
attempt to incorporate such effects in this model, but the 
precise modeling of neuromodulation, and possible tran- 
sitions from AI to various types of oscillatory behavior, 
constitutes a possible extension of the model. 

The presence of LTS neurons tends to greatly favor AI 
states. This is consistent with the genesis of AI states in 
very small thalamic networks (N'^lOO; Fig. |4]l, where all 
neurons display LTS. In cortex, inclusion of a small pro- 
portion of LTS cells (as observed experimentally; see de la 
Pena and Geijo-Barrientos, 1996; Destexhe et al., 2001), 
greatly reduces the minimal size to display AI states. The 
probable mechanisms is that LTS cells renders the network 



10 



Cortex - Layer A 




1000 2000 3000 4000 5000 
Time Cms) 



Fig. 13 Up/Down state dynamics in a 2-layer cortex model with 
LTS cells. Top: Scheme of connectivity between two networks of 
A'=2000 (Layer A) and A'=500 (Layer B) neurons. Layer B had 10% 
LTS cells and was capable of displaying self-sustained AI states. 
Bottom: Raster of the activity during 5 seconds (LTS cells shown 
in red). The stimulation of the network started at /=250 ms (arrow), 
and switched the stable resting state to self-sustained Up/Down state 
dynamics (CV/57 = 2.49, CC = 0.069). Parameters for the Layer A 
network were identical to Fig. |6]\, and Layer B was identical as 
Fig.|7j3, with 10% of LTS cells. The interlayer connectivity was only 
excitatory and had a connection probability of 1%. 



insensitive to "gaps" of firing, caused by occasional syn- 
chronized inhibition, and which usually stops the activity. 
These gaps are followed by rebound bursts in a minority 
of LTS cells if they are present, and thus renders the net- 
work less vulnerable to such gaps. This also suggests that 
LTS cells could be indicative of networks that generate AI 
type of activity. It would be interesting to investigate in 
more detail, and perhaps theoretically, the contrasting ef- 
fects of adaptation and LTS on the genesis of AI states. 
Inclusion of other types of bursting cells, such as intrin- 
sically bursting neurons (Connors and Gutnick, 1990) or 
inhibitory LTS cells (Xiang et al., 1998), also constitutes a 
possible extension of this study. 

In the thalamocortical system, the association of thala- 
mic networks and cortical networks generates a variety of 
states, including AI states and different forms of Up/Down 
state dynamics, for different levels of adaptation in cortical 
excitatory cells. Reducing adaptation, mimicking the ac- 
tion of some neuromodulators such as acetylcholine, may 
induce a transition from Up/Down state dynamics to sus- 
tained AI states. This transition is similar to the activation 
of the brain by neuromodulators, which also can produce a 
transition between slow-wave activity with Up/Down state 
dynamics, to the so-called "desynchronized" EEG activ- 
ity. This transition naturally occurs upon awakening from 



slow-wave sleep (Steriade, 2003), or can be induced by 
stimulation of the ascending neuromodulatory systems (Ste- 
riade et al, 1993a; Fig.ll2A). and can be mimicked by the 
thalamocortical model by a reduction of the adaptation pa- 
rameter b (Fig.ll2B). This is consistent with the action of 
neuromodulators, such as acetylcholine, to block or reduce 
conductances responsible for spike-frequency adapta- 
tion (McCormick, 1992). 

In this paper, there was no attempt to reproduce the cor- 
rect cellular conductance patterns of the different network 
states. Experimental measurements show that the input re- 
sistance of cortical neurons in vivo is reduced by 3 to 5 
times compared to quiescent states, in both anesthetized 
animals (Contreras et al., 1996; Borg-Graham et al., 1998; 
Pare et al., 1998; Destexhe and Pare, 1999) and awake an- 
imals (Baranyi et al., 1993a, 1993b; Steriade et al., 2001; 
reviewed in Destexhe et al., 2003; Destexhe, 2007). The 
excitatory and inhibitory synaptic conductances were also 
measured in anesthetized (Borg-Graham et al., 1998; Rudolph 
et al., 2005) and awake preparations (Rudolph et al., 2007). 
Reproducing the correct conductance state in individual 
neurons requires large network sizes (El Boustani et al., 
2007; Kumar et al., 2008), and was not attempted here. 
We rather focused on the minimal size necessary to obtain 
AI states in different network configurations, but obtaining 
states fully consistent with experimental data will require 
substantial computational resources to simulate large net- 
works of aelF neurons, and constitutes a logical follow-up 
of this study. 

It is also interesting to note that this thalamocortical model 
is different than previous models of Up/Down states in 
cortical networks (Timofeev et al., 2000; Compte et al., 
2003; Parga and Abbott, 2007). Previous models have con- 
sidered additional mechanisms to initiate Up states, which 
amounts to have some cortical neurons spontaneously fir- 
ing or external noise. In contrast, Up/Down state dynam- 
ics arise here entirely from self-sustained activity. In the 
thalamocortical model, the cortex is in a state generating 
transient dynamics (as in Fig. ISK), while the thalamus is 
in an AI state. The system generates a transient Up state, 
then the activity stops, leading to a Down state. The activ- 
ity restarts due to the firing of TC cells which triggers a 
new Up state, and the cycle restarts. This model therefore 
does not generate Up/Down state dynamics in the cortex 
alone, contrary to observations of Up/Down states in corti- 
cal slices (Sanchez- Vives and McCormick, 2000; Cossart 
et al., 2003) or in cortical organotypic cultures (Plenz and 
Aertsen, 1996). It nevertheless accounts for the fact that 
the thalamus ignites the Up states in the intact thalamocor- 
tical system in vivo (Contreras and Steriade, 1995; Grenier 
et al., 1998). 

Similar Up/Down state dynamics were also observed in 
a more sophisticated model of the cortex allowing lay- 
ered connectivity, in which a small sub-network played 
the role of AI state generator, while the rest of the net- 
work was passive and generated transient dynamics, as 
in Fig. |6K- The interconnections between two such net- 
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works generated Up/Down state dynamics very similar to 
the thalamocortical model, except that in this case, the ac- 
tivity was entirely generated within the cortex, in agree- 
ment with cortical slice experiments. The sub-network dis- 
playing self-sustained AI states (Layer B in Fig. [13]) may 
represent Layer V networks, which were reported to initi- 
ate the activity during Up states in cortical slices (Sanchez- 
Vives and McCormick, 2000). Also similar to the thalam- 
ocortical model, this two-layer model of the cortex gen- 
erated Up/Down state dynamics entirely from the inter- 
nal dynamics of the system, without the requirement of 
spontaneously firing cells, or additional noise, as in previ- 
ous models. The bistability of this system was illustrated 
by the coexistence of a stable resting state and Up/Down 
state dynamics (Fig.[l3j arrow). Note that here, the specific 
choice of networks with LTS cells (layer B) should not 
be considered as a prediction, as similar dynamics should 
also be observed if Layer B was a network of RS and 
FS cells displaying AI states (as in Fig. |6^). The essen- 
tial prediction here is that a network with self-sustained 
activity, combined with another network displaying spike- 
frequency adaptation, is a possible generator of self-sustained 
Up/Down state dynamics. 

Finally, the present model reports a variety of AI states in 
different network configurations, but it is important to note 
that AI states may be transient in nature. Transient chaotic 
regimes have been extensively studied (Crutchfield and 
Kaneko, 1988; Zillmer et al., 2006; Cessac, 2008; Cessac 
and Vieville, 2009; reviewed in Tel and Lai, 2008). The 
lifetime of these transient regimes is known to increase 
exponentially with network size (Crutchfield and Kaneko, 
1988; Kumar et al., 2008; Tel and Lai, 2008; El Boustani 
and Destexhe, 2009). For large networks, of the order of 
thousand or more neurons, this lifetime can reach consid- 
erable times (beyond any reasonable simulation time; see 
Kumar et al., 2008). It is thus difficult to formally estab- 
lish the transient nature of such states with numerical sim- 
ulations. However, although AI states may not represent 
a stable attractor of the system, they are nevertheless rel- 
evant because they represent the dynamics of the system 
within any reasonably accessible time period. 

In conclusion, we have shown here what should be con- 
sidered as the beginning of an exploration of the collective 
dynamics of populations of neurons endowed with com- 
plex intrinsic properties as given by the aelF model. The 
presence of such properties has important effects on net- 
work behavior, and in particular affects the genesis of AI 
state. AI states are not possible in small networks without 
LTS properties, which certainly constitutes an interesting 
prediction. More generally, future studies should investi- 
gate intrinsic properties as a continuum rather than distinct 
neuronal classes. Such a continuum should be possible to 
define using IF models such as the aelF model used here. 
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